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Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

• If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

• Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )S Responsive to communication(s) filed on 18 March 2004 . 
2a)D This action is FINAL. 2b)E3 This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayie, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) [3 Claim(s) 1-23.27-35,43 and 44 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) ^ Claim(s) 1-23.27-35.43 and 44 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) [3 The drawing(s) filed on 05 June 2000 is/are: a)|3 accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12) 03 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)IE All b)D Some * c)D None of: 

1 .E3 Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 
Priority 

1 . Receipt is acknowledged of papers submitted under 35 U.S. C. 11 9(a)-(d), which papers 
have been placed of record in the file. 

Response to Arguments 

2. Applicant's arguments on page 7, filed February 4, 2004, with respect to the abstract and 
claims 3 and 34 have been fully considered and are persuasive. The objections to the 
specification and claims 3 and 34 have been withdrawn. 

3. Applicant's arguments, filed February 4, 2004, with respect to the rejection(s)of claim(s) 

1 and 27 under 35 U.S.C. § 102(b) have been fully considered and are persuasive. Therefore, the 
rejection has been withdrawn. However, upon further consideration, a new ground(s) of 
rejection is made in view of Eleftheriadis et al. (USPN 6,055,330, previously cited). 

4. Applicant's arguments with respect to the remainder of the claims have been considered 
but are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 102 

5. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 35 1 (a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 

6. Claims 1-4, 13, 14, 18, 27, 28, and 32-35 are rejected under 35 U.S.C. 102(e) as being 
anticipated by Eleftheriadis et al. (USPN 6,055,330, previously cited), hereafter Eleftheriadis. 
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7. Regarding claim 1, Eleftheriadis discloses a method of producing a depth map (column 9, 
line 17-28) comprising the steps of: identifying at least one object (via video object selector) 
within a 2D image (column 8, line 52-61; column 17, line 1-20); allocating an identifying tag 
(label, number) to the at least one object (column 10, line 34-45, line 65-column 11, line 23; 
column 18, line 36-44); allocating a depth tag (value) to the at least one object (column 10, line 
13-26; column 17, line 40-52); and determining and defining an outline (boundary) of the at least 
one object (column 9, line 45-column 10, line 26; column 17, line 40-52). 

8. Regarding claim 2, Eleftheriadis discloses that the object outline (contour, border, 
boundary) is defined by a series of coordinates, curves, and/or geometric shapes (column 15, line 
48-61; column 16, line 20-33; column 18, line 56-65). 

9. Regarding claim 3, Eleftheriadis discloses that said identifying tag (label) is a unique 
number (column 18, line 36-44). 

10. Regarding claim 4, Eleftheriadis discloses that identifying said at least one object (object 
map generated) occurs prior to said determining and defining step (scanning clipped histogram to 
find region boundaries; column 17, line 40-52) and includes the step of comparing (inherent 
since a shape difference between two objects is computed) said 2D image with a library of 
generic scenes (stored frames, standard digital image; column 7, line 58-62; column 16, line 20- 
43; column 18, line 45-65). 

1 1 . Regarding claim 13, Eleftheriadis discloses that said depth tag is a numerical value 
(column 9, line 17-28). 

12. Regarding claim 14, Eleftheriadis discloses that said numerical value (depth signal 102) 
ranges from 0 to 255 (included in 16-bit linear representation of values, column 7, line 20-27). 
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13. Regarding claim 18, Eleftheriadis discloses tracking the at least one object (video object 
plane, VOP) on successive frames of the image, and determining and assigning depth tags for the 
at least one object in each respective frame (column 18, line 45-55). 

14. Regarding claim 27, Eleftheriadis discloses a method of encoding a depth map (column 
9, line 17-28) including: allocating an object identifier (label) to an object (column 10, line 34- 
45, line 65-column 11, line 23; column 18, line 36-44); allocating a depth tag (value) to said 
object (column 10, line 13-26; column 17, line 40-52); and defining an outline (boundary) of the 
object (column 9, line 45-column 10, line 26; column 17, line 40-52). 

1 5. Regarding claim 28, Eleftheriadis discloses that said object outline (contour, border, 
boundary) is defined by a series of x,y (pixel) coordinates, each x,y coordinate being separated 
by a curve (column 15, line 48-61; column 18, line 56-65). 

16. Regarding claim 32, Eleftheriadis discloses that said object outline is defined by at least 
one geometric shape (column 15, line 48-61; column 16, line 20-43). 

17. Regarding claim 33, Eleftheriadis discloses that said at least one geometric shape is 
defined by the form of the shape and the parameters of the shape (column 15, line 48-61; column 
16, line 20-43). 

18. Regarding claim 34, Eleftheriadis discloses that said allocating the depth tag includes: 
allocating a type (16-bit linear representation) of depth (column 7, line 20-27); and allocating a 
depth for the object (column 10, line 13-26). 

19. Regarding claim 35, Eleftheriadis discloses that the type of depth includes single value, 
linear ramp, or radial ramp (column 7, line 20-27; column 9, line 17-28). 

Claim Rejections - 35 USC § 103 
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20. The following is a quotation of 35 U.S.G 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

21 . Claims 5, 19, and 21-23 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Eleftheriadis as applied to claims 1 and 2 above. 

22. Regarding claim 5, Eleftheriadis discloses a boundary computing circuit that identifies 
depth points between objects in the scene (column 9, line 45-50), but does not explicitly disclose 
that determining the outline includes tracing the object pixel by pixel. The examiner takes 
Official Notice that determining the outline of an object by tracing the object pixel by pixel is 
well known in the art. It would have been obvious to one of ordinary skill in the art at the time 
the invention was made to trace the object pixel by pixel as taught by Eleftheriadis in order to 
accurately determine the outline of the object so that it can be extracted or otherwise processed. 

23. Regarding claims 19, 21, and 22, Eleftheriadis discloses that compression is performed in 
both texture and shape individually for each object (column 15, line 56-61), but does not 
explicitly disclose adding a texture bump map to the at least one object, wherein the texture 
bump map is defined by luminance values, chrominance, saturation, color grouping, reflections, 
shadows, focus, and/or sharpness of individual components of the at least one object. The 
examiner takes Official Notice that adding a texture bump map to an object defined by 
luminance, chrominance, saturation, color grouping, reflections, shadows, focus, and/or 
sharpness is well known in the art of computer graphics. It would have been obvious to one of 
ordinary skill in the art at the time the invention was made to add a texture bump map to the at 
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least one object in order to give the object a more life-like appearance by adding texture and 
shading to an otherwise flat surface. 

24. Regarding claim 23, Eleftheriadis discloses that depth information signal 102 is a 16-bit 
linear representation of depth (column 7, line 20-27), which means that there are 65,536 possible 
depths in the scene (column 10, line 34-45). It is also disclosed that each macroblock associated 
with an object is a 16 x 16 array of pixels (column 11, line 16-23), which would mean that 
images of 16x16x16 bit resolution are produced. Eleftheriadis does not disclose that images of 
80x60x8 bit resolution of each 2D image are produced, but the specific dimensions of produced 
images depends on the design and requirements of the particular system It would have been 
obvious to one of ordinary skill in the art at the time the invention was made to produce 
grayscale images of 80x60x8 bit resolution of each 2D image in order to satisfy specific design 
requirements of the particular system. 

25. Claims 6-10, and 29-31 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Eleftheriadis as applied to claims 1, 2, and 28 above, and further in view of Meek et al. (USPN 
6,029,173, newly cited), hereafter Meek. 

26. Regarding claims 6-8, Eleftheriadis does not explicitly disclose that the step of 
determining the outline further includes using straight lines, curve approximations, or Bezier 
curves to approximate the outline of the at least one object. Meek discloses that the step of 
determining an outline further includes using straight line, curve, and Bezier curve 
approximations to approximate the outline of the at least one object (column 6, line 20-30). It 
would have been obvious to one of ordinary skill in the art at the time the invention was made to 
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use straight line, curve, and Bezier curve approximations to approximate an outline as taught by 
Meek in order to minimize the storage requirements while providing a high level of accuracy in 
the representation of other-than-straight (curved) features (column 4, line 32-46). 

27. Regarding claim 9, Eleftheriadis does not explicitly disclose that the step of determining 
the outline further includes comparing the object with a library of curves and/or generic 
geometric shapes to approximate the outline. Meek discloses a method and system for 
representation and use of shape information in geographic databases wherein a step of 
determining an outline (shape) includes comparing (matching) the object with a library of curves 
(column 8, line 50-64) and/or generic or geometric shapes to approximate the outline (column 6, 
line 14-30; column 8, line 20-48). It would have been obvious to one of ordinary skill in the art 
at the time the invention was made to compare the object with a library of curves and/or generic 
geometric shapes as taught by Meek in order to approximate the outline and minimize the 
storage requirements while providing a high level of accuracy in the representation of other-than- 
straight (curved) features (column 4, line 32-46). 

28. Regarding claim 10, Meek discloses that the curve and/or generic or geometric shape are 
scaled to best fit the object (column 8, line 50-64). 

29. Regarding claim 29, Eleftheriadis discloses that each identifying tag is a unique number 
(column 18, line 36-44), but does not disclose that each curve is stored in a library and allocated 
a unique number. Meek discloses that each curve (other-than-straight segment) is stored in a 
library and allocated a unique numerical number (index reference value; column 8, line 60-64). 
It would have been obvious to one of ordinary skill in the art at the time the invention was made 
to store each curve in a library and allocate each curve a unique number as taught by Meek in 
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order to further minimize the storage requirements while providing a high level of accuracy in 
the representation of other-than-straight (curved) features (column 4, line 32-46; column 5, line 
6-10). 

30. Regarding claim 30, Meek discloses that said object outline also includes data on the 
orientation (rotation) of each curve (column 8, line 50-64). 

3 1 . Regarding claim 31, Meek discloses that each said curve is a Bezier curve (column 6, line 
14-30). 

32. Claims 1 1 and 12 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Eleftheriadis as applied to claim 1 above, and further in view of Nourbakhsh et al. (USPN 
5,793,900, cited on applicant's IDS), hereafter Nourbakhsh. 

33. Regarding claims 1 1 and 12, Eleftheriadis does not disclose that the depth tag includes a 
color code, wherein white represents one of objects relatively close to the viewer, or objects 
relatively distant from the viewer and black represents the other. Nourbakhsh discloses 
generating categorical depth maps using passive defocus sensing wherein a depth map is an array 
of categorical depth values, each value indicating the depth of the scene for a given region such 
that depth values of 2, 1, and 0 correspond to close, medium, and far, respectively (column 5, 
line 9-15). Nourbakhsh further discloses that close regions are lightly shaded, medium regions 
are medium shaded, and far regions are darkly shaded (Figures 2-7; column 5, line 20-25). It 
would have been obvious to one of ordinary skill in the art at the time the invention was made to 
represent objects relatively close to the viewer as white, and objects relatively distant from the 
viewer with black as taught by Nourbakhsh in order to give the viewer an impression of depth 



Application/Control Number: 09/586,869 Page 9 

Art Unit: 2623 

using varying pixel intensities since a brighter portion logically indicates a closer portion which 
is easier to see, and a darker portion indicates a distant portion which is more difficult to see 
(column 5, line 20-31). 

34. Claims 15-17, 20, 43, and 44 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Eleftheriadis as applied to claims 1,19, and 27 above, and further in view of Geshwind et 
al. (USPN 4,925,294, previously cited), hereafter Geshwind. 

35. Regarding claim 15, Eleftheriadis discloses a region selector that preprocesses the object 
map to identify which pixels are within each depth range, then identifies one or more video 
objects existing within that region (column 17, line 9-20), but does not disclose that said at least 
one object is further divided into a plurality of segments, each segment being assigned a depth 
tag. Geshwind discloses that said at least one object (image element) is further divided into a 
plurality of segments (portions), each segment being assigned a depth tag (column 5, line 1-4). It 
would have been obvious to one of ordinary skill in the art at the time the invention was made to 
divide each object into a plurality of segments and assign each segment a depth tag as taught by 
Geshwind in order to designate areas of objects that are closer to the viewer than other areas of 
the same object (column 5, line 4-15). 

36. Regarding claims 16 and 17, Geshwind discloses that different portions of a single image 
element may be given different depth designations with the computer interpolating depth 
coordinates over the entire element (column 5, line 1-15) and also that depth interpolation may 
be carried out over time between frames and that linear and non-linear interpolation are well 
known (column 5, line 16-27), but does not disclose that the variation in depth is defined by a 
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linear or radial ramp function. A ramp is simply a linear, uniformly increasing function. The 
examiner takes Official Notice that linear or radial ramp functions are well known in the art. It 
would have been obvious to one of ordinary skill in the art at the time the invention was made to 
define the variation in depth by a linear or radial ramp function as taught by Geshwind in order 
to create uniformly changing variations in the depth of a single object (column 5, line 1-15). 

37. Regarding claim 20, it has been shown that adding a texture bump map to an object is 
well known in the art (see above discussion of claim 19), but Eleftheriadis does not disclose 
breaking the at least one object into a plurality of components and assigning each component a 
depth tag. Geshwind discloses that said at least one object (image element) is further divided 
into a plurality of segments (portions), each segment being assigned a depth tag (see above 
discussion of claim 15). 

38. Regarding claims 43 and 44, Eleftheriadis does not disclose a method of converting 2D 
images into stereoscopic images applying a depth map generated according to the method of 
claim 1 or applying an encoded depth map generated according to the method of claim 27. 
Geshwind discloses a method to convert two-dimensional motion pictures into left and right 
images for three-dimensional systems using depth information (column 3, line 17-37). It would 
have been obvious to one of ordinary skill in the art at the time the invention was made to 
convert 2D images into stereoscopic (left and right) images by applying a depth map generated 
or encoded according to the methods of claims 1 or 27 as taught by Geshwind in order to 
enhance original two-dimensional images so as to exhibit at least some three-dimensional or 
depth characteristics to be used with three-dimensional exhibition or transmission systems 
(column 2, line 41-54). 
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Conclusion 

39. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

• USPN 3,772,465 to Vlahos et al. discloses image modification of motion pictures 
wherein each object in the image is assigned an identifying number and associated 
with boundary addressees of that object. 

• USPN 3,805,238 to Rothfjell discloses a method for identifying individuals using 
selected characteristic body curves compared with stored curves. 

• USPN 4,682,189 to Purdy et al. discloses reproduction of character images by 
selecting appropriate curve sections from memory to match the desired outline. 

• USPN 5,247,583 to Kato et al. discloses an image segmentation method and 
apparatus wherein a shape model is roughly correlated with nodes on the contour of 
the image. 

• USPN 5,333,209 to Sinden et al. discloses a method of recognizing handwritten 
symbols by comparing unknown symbols with a predefined library of model symbols. 

• USPN 5,673,377 to Berkaloff discloses a method and system for displaying a 
representation of a three-dimensional object with surface features including the use of 
Bezier curves. 

• NNRD 41394 "Rendering depth maps" IBM research disclosure including projective 
texture mapping to create an image that forms a depth map of a scene including a 
color ramp wherein red, green, and blue values increase with increasing depth. 
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• WO 97/24000 to Richard discloses image conversion and encoding techniques 
including producing left and right eye images for a stereoscopic display from an 
original 2D image. 

• WO 2001/39125 to Fox discloses a depth map compression technique including 
Bezier curves and ramp functions. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Ryan J Hesseltine whose telephone number is 703-306-4069. 
The examiner can normally be reached on Monday - Friday, 8:30 AM - 5 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Amelia Au can be reached on 703-308-6604. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



Ryan J. Hesseltine 
May 14, 2004 




